Accurate Segmentation Research Articles

Cardiac MRI segmentation using shifted-window multilayer perceptron mixer networks.

In this work, we proposed a deep-learning segmentation algorithm for cardiac magnetic resonance imaging (MRI) to aid in contouring of the left ventricle (LV), right ventricle (RV), and Myocardium (Myo). 
Methods: We proposed a shifted window multilayer perceptron (Swin-MLP) mixer network which is built upon a 3D U-shaped symmetric encoder-decoder structure. We evaluated our proposed network using public data from 100 individuals. The network performance was quantitatively evaluated using 3D volume similarity between the ground truth contours and the predictions using Dice score coefficient, sensitivity, and precision as well as 2D surface similarity using Hausdorff distance (HD), mean surface distance (MSD) and residual mean square distance (RMSD). We benchmarked the performance against two other current leading edge networks known as Dynamic UNet and Swin-UNetr on the same public dataset. 
Results: The proposed network achieved the following volume similarity metrics when averaged over three cardiac segments: Dice = 0.952±0.017, precision = 0.948±0.016, sensitivity = 0.956±0.022. The average surface similarities were HD = 1.521±0.121 mm, MSD = 0.266±0.075 mm, and RMSD = 0.668±0.288 mm. The network shows statistically significant improvement in comparison to the Dynamic UNet and Swin-UNetr algorithms for most volumetric and surface metrics with p-value less than 0.05. Overall, the proposed Swin-MLP mixer network demonstrates better or comparable performance than competing methods. 
Conclusions: The proposed Swin-MLP mixer network demonstrates more accurate segmentation performance compared to current leading edge methods. This robust method demonstrates the potential to streamline clinical workflows for multiple applications.

Sample Size Effect on Musculoskeletal Segmentation: How Low Can We Go?

Convolutional Neural Networks have emerged as a predominant tool in musculoskeletal medical image segmentation. It enables precise delineation of bone and cartilage in medical images. Recent developments in image processing and network architecture desire a reevaluation of the relationship between segmentation accuracy and the amount of training data. This study investigates the minimum sample size required to achieve clinically relevant accuracy in bone and cartilage segmentation using the nnU-Net methodology. In addition, the potential benefit of integrating available medical knowledge for data augmentation, a largely unexplored opportunity for data preprocessing, is investigated. The impact of sample size on the segmentation accuracy of the nnU-Net is studied using three distinct musculoskeletal datasets, including both MRI and CT, to segment bone and cartilage. Further, the use of model-informed augmentation is explored on two of the above datasets by generating new training samples implementing a shape model-informed approach. Results indicate that the nnU-Net can achieve remarkable segmentation accuracy with as few as 10–15 training samples on bones and 25–30 training samples on cartilage. Model-informed augmentation did not yield relevant improvements in segmentation results. The sample size findings challenge the common notion that large datasets are necessary to obtain clinically relevant segmentation outcomes in musculoskeletal applications.

An improvement method for pancreas CT segmentation using superpixel-based active contour

Objective. Pancreas is one of the most challenging organs for Computed Tomograph (CT) image automatic segmentation due to its complex shapes and fuzzy edges. It is simple and universal to use the traditional segmentation method as a post-processor of deep learning method for segmentation accuracy improvement. As the most suitable traditional segmentation method for pancreatic segmentation, the active contour model (ACM), still suffers from the problems of weak boundary leakage and slow contour evolution speed. Therefore, a convenient post-processor for any deep learning methods using superpixel-based active contour model (SbACM) is proposed to improve the segmentation accuracy. Approach. Firstly, the superpixels with strong adhesion to edges are used to guide the design of narrowband and energy function. A multi-scale evolution strategy is also proposed to reduce the weak boundary leakage and comprehensively improve the evolution speed. Secondly, using the original image and the coarse segmentation results obtained from deep learning methods as inputs, the proposed SbACM method is used as a post-processor for fine segmentation. Finally, the pancreatic segmentation public dataset TCIA from the National Institutes of Health(NIH, USA) is used for evaluation, and the Wilcoxon Test confirmed that the improvement of proposed method is statistically significant. Main results. (1) the superpixel-based narrowband shape and dynamic edge energy of the proposed SbACM work for boundary leakage reduction, as well as the multi-scale evolution strategy and dynamic narrowband width for the evolution speed improvement; (2) as a post-processor, SbACM can increase the Dice similarity coefficients (DSC) of five typical UNet-based models, including UNet, SS-UNet, PBR UNet, ResDSN, and nnUNet, 2.35% in average and 9.04% in maximum. (3) Based on the best backbone nnUNet, the proposed post-processor performs better than either adding edge awareness or adding edge loss in segmentation enhancement without increasing the complexity and training time of deep learning models. Significance. The proposed SbACM can improve segmentation accuracy with the lowest cost, especially in cases of squeezed fuzzy edges with similar neighborhood , and complex edges.

Automatic segmentation of dura for quantitative analysis of lumbar stenosis: A deep learning study with 518 CT myelograms.

The diagnosis of lumbar spinal stenosis (LSS) can be challenging because radicular pain is not often present in the culprit-level localization. Accurate segmentation and quantitative analysis of the lumbar dura on radiographic images are key to the accurate differential diagnosis of LSS. The aim of this study is to develop an automatic dura-contouring tool for radiographic quantification on computed tomography myelogram (CTM) for patients with LSS. A total of 518 CTM cases with or without lumbar stenosis were included in this study. A deep learning (DL) segmentation algorithm 3-dimensional (3D) U-Net was deployed. A total of 210 labeled cases were used to develop the dura-contouring tool, with the ratio of the training, independent testing, and external validation datasets being 150:30:30. The Dice score (DCS) was the primary measure to evaluate the segmentation performance of the 3D U-Net, which was subsequently developed as the dura-contouring tool to segment another unlabeled 308 CTM cases with LSS. Automatic masks of 446 slices on the stenotic levels were then meticulously reviewed and revised by human experts, and the cross-sectional area (CSA) of the dura was compared. The mean DCS of the 3D U-Net were 0.905±0.080, 0.933±0.018, and 0.928±0.034 in the five-fold cross-validation, the independent testing, and the external validation datasets, respectively. The segmentation performance of the dura-contouring tool was also comparable to that of the second observer (the human expert). With the dura-contouring tool, only 59.0% (263/446) of the automatic masks of the stenotic slices needed to be revised. In the revised cases, there were no significant differences in the dura CSA between automatic masks and corresponding revised masks (p=0.652). Additionally, a strong correlation of dura CSA was found between the automatic masks and corresponding revised masks (r=0.805). A dura-contouring tool was developed that could automatically segment the dural sac on CTM, and it demonstrated high accuracy and generalization ability. Additionally, the dura-contouring tool has the potential to be applied in patients with LSS because it facilitates the quantification of the dural CSA on stenotic slices.

Adipose Tissue Segmentation after Lung Slice Localization in Chest CT Images Based on ConvBiGRU and Multi-Module UNet

The distribution of adipose tissue in the lungs is intricately linked to a variety of lung diseases, including asthma, chronic obstructive pulmonary disease (COPD), and lung cancer. Accurate detection and quantitative analysis of subcutaneous and visceral adipose tissue surrounding the lungs are essential for effectively diagnosing and managing these diseases. However, there remains a noticeable scarcity of studies focusing on adipose tissue within the lungs on a global scale. Thus, this paper introduces a ConvBiGRU model for localizing lung slices and a multi-module UNet-based model for segmenting subcutaneous adipose tissue (SAT) and visceral adipose tissue (VAT), contributing to the analysis of lung adipose tissue and the auxiliary diagnosis of lung diseases. In this study, we propose a bidirectional gated recurrent unit (BiGRU) structure for precise lung slice localization and a modified multi-module UNet model for accurate SAT and VAT segmentations, incorporating an additive weight penalty term for model refinement. For segmentation, we integrate attention, competition, and multi-resolution mechanisms within the UNet architecture to optimize performance and conduct a comparative analysis of its impact on SAT and VAT. The proposed model achieves satisfactory results across multiple performance metrics, including the Dice Score (92.0% for SAT and 82.7% for VAT), F1 Score (82.2% for SAT and 78.8% for VAT), Precision (96.7% for SAT and 78.9% for VAT), and Recall (75.8% for SAT and 79.1% for VAT). Overall, the proposed localization and segmentation framework exhibits high accuracy and reliability, validating its potential application in computer-aided diagnosis (CAD) for medical tasks in this domain.

Enhancing the Segmentation Accuracy of the Otsu Method for Calculating Blood Vessel Rupture Volumes in CT-Scan Images

Enhancing the Segmentation Accuracy of the Otsu Method for Calculating Blood Vessel Rupture Volumes in CT-Scan Images

Building footprint extraction from aerial images using an edge-aware YOLO-v8 network

Abstract. Building footprint extraction is a critical indicator for assessing urban infrastructure, and extracting building footprints from remote sensing imagery can have significant practical applications. However, achieving rapid and accurate extraction of building footprints remains highly challenging, especially in scenarios with complex scenes, dense building distributions, and small targets. The instance segmentation models of the YOLO series offer strong real-time performance, reducing considerable time and effort in practical applications. Therefore, we propose building footprint extraction based on an enhance YOLO-v8 network. This study focuses on three enhancements to the YOLO-v8 network to improve extraction accuracy. Building upon the YOLO-v8 framework, we have incorporated the Feature Pyramid Network (FPN) module into feature maps at all scales to efficiently propagate high-level semantic information. Additionally, we introduce the Triple Feature Encoder (TFE) module, which integrates spatial detail information from feature maps at three different scales to enhance the network's ability to extract multi-scale information. Finally, we explore the integration of the Prewitt model, a conventional edge detection operator, to assist in extracting edge features in target regions of feature maps. This integration aims to reduce the jagged edges frequently seen in the outcomes of the original YOLO-v8. Furthermore, the Prewitt operator's noise suppression capability helps mitigate the influence of non-target areas in the feature maps. The proposed framework achieves an instance segmentation accuracy of mAP50 is 84.6% and mAP50:95 is 51.4% on public datasets, outperforming the original YOLO-v8 network.

A preliminary study on the identification of microcracks on the aggregate surface of asphalt pavements under cumulative tire wear

This paper presents a microcrack segmentation method and two-dimensional planar parameters to quantitatively characterize microcracks in aggregates under tire loading. First, an aggregate sample with extensive repeated tire wear was collected from the pavement surface for rock CT scanning. The acquired grayscale images were pre-processed by image filtering and appropriate image enhancement. Then, a microcrack segmentation method for aggregate damage analysis was developed based on the edge region growth algorithm and compared with the traditional threshold segmentation method. Finally, based on the microcrack segmentation results, the distribution pattern of microscopic characteristic parameters of aggregate surface microcracks was revealed. The results show that the best image pre-processing scheme is to first reduce the noise in the gray-scale images by using the Gaussian and median filters together, and then enhance their local details by gamma transform. Compared with the traditional threshold segmentation method, the proposed method effectively improves the microcrack segmentation accuracy by setting a large number of seed positions and adjusting their growth patterns. Moreover, the microscopic characteristic parameter distribution pattern of aggregate microcracks in each layer suggests that the crack extension degree on the pavement aggregate surface directly subjected to tire loads is generally larger than that on other parts. In addition, the microcracks are not only densely distributed within the aggregate surface layer, but also tend to extend deeper, indicating that the effect of cumulative tire loads on frictional damage to the pavement surface needs to be investigated in the field of pavement skid resistance research.

Automatic classification and segmentation of blast cells using deep transfer learning and active contours.

Acute lymphoblastic leukemia (ALL) presents a formidable challenge in hematological malignancies, necessitating swift and precise diagnostic techniques for effective intervention. The conventional manual microscopy of blood smears, although widely practiced, suffers from significant limitations including labor-intensity and susceptibility to human error, particularly in distinguishing the subtle differences between normal and leukemic cells. To overcome these limitations, our research introduces the ALLDet classifier, an innovative tool employing deep transfer learning for the automated analysis and categorization of ALL from White Blood Cell (WBC) nuclei images. Our investigation encompassed the evaluation of nine state-of-the-art pre-trained convolutional neural network (CNN) models, namely VGG16, VGG19, ResNet50, ResNet101, DenseNet121, DenseNet201, Xception, MobileNet, and EfficientNetB3. We augmented this approach by incorporating a sophisticated contour-based segmentation technique, derived from the Chan-Vese model, aimed at the meticulous segmentation of blast cell nuclei in blood smear images, thereby enhancing the accuracy of our analysis. The empirical assessment of these methodologies underscored the superior performance of the EfficientNetB3 model, which demonstrated exceptional metrics: a recall specificity of 98.5%, precision of 95.86%, F1-score of 97.16%, and an overall accuracy rate of 97.13%. The Chan-Vese model's adaptability to the irregular shapes of blast cells and its noise-resistant segmentation capability were key to capturing the complex morphological changes essential for accurate segmentation. The combined application of the ALLDet classifier, powered by EfficientNetB3, with our advanced segmentation approach, emerges as a formidable advancement in the early detection and accurate diagnosis of ALL. This breakthrough not only signifies a pivotal leap in leukemia diagnostic methodologies but also holds the promise of significantly elevating the standards of patient care through the provision of timely and precise diagnoses. The implications of this study extend beyond immediate clinical utility, paving the way for future research to further refine and enhance the capabilities of artificial intelligence in medical diagnostics.

Segmentation and Tracking Based on Equalized Memory Matching Network and Its Application in Electric Substation Inspection

With the wide application of deep learning, power inspection technology has made great progress. However, substation inspection videos often present challenges such as complex backgrounds, uneven lighting distribution, variations in the appearance of power equipment targets, and occlusions, which increase the difficulty of object segmentation and tracking, thereby adversely affecting the accuracy and reliability of power equipment condition monitoring. In this paper, a pixel-level equalized memory matching network (PEMMN) for power intelligent inspection segmentation and tracking is proposed. Firstly, an equalized memory matching network is designed to collect historical information about the target using a memory bank, in which a pixel-level equalized matching method is used to ensure that the reference frame information can be transferred to the current frame reliably, guiding the segmentation tracker to focus on the most informative region in the current frame. Then, to prevent memory explosion and the accumulation of segmentation template errors, a mask quality evaluation module is introduced to obtain the confidence level of the current segmentation result so as to selectively store the frames with high segmentation quality to ensure the reliability of the memory update. Finally, the synthetic feature map generated by the PEMMN and the mask quality assessment strategy are unified into the segmentation tracking framework to achieve accurate segmentation and robust tracking. Experimental results show that the method performs excellently on real substation inspection scenarios and three generalized datasets and has high practical value.

Advanced Integration of Machine Learning Techniques for Accurate Segmentation and Detection of Alzheimer’s Disease

Alzheimer’s disease is a common type of neurodegenerative condition characterized by progressive neural deterioration. The anatomical changes associated with individuals affected by Alzheimer’s disease include the loss of tissue in various areas of the brain. Magnetic Resonance Imaging (MRI) is commonly used as a noninvasive tool to assess the neural structure of the brain for diagnosing Alzheimer’s disease. In this study, an integrated Improved Fuzzy C-means method with improved watershed segmentation was employed to segment the brain tissue components affected by this disease. These segmented features were fed into a hybrid technique for classification. Specifically, a hybrid Convolutional Neural Network–Long Short-Term Memory classifier with 14 layers was developed in this study. The evaluation results revealed that the proposed method achieved an accuracy of 98.13% in classifying segmented brain images according to different disease severities.

Accurate Segmentation Method for Roadside Lampposts Based on Vehicle-Mounted Lidar Point Clouds

Abstract. The extraction of roadside lampposts constitutes a significant research focus within the domain of vehicular LiDAR point cloud object retrieval. Addressing the complexities inherent in discerning lampposts amidst convoluted vegetation in diverse roadway settings, this study introduces an innovative, progressive technique for the individualized extraction of lampposts utilizing vehicular LiDAR point clouds. The proposed method initiates with a bifurcation of the primary point cloud into terrestrial and aerial subsets via the Cloth Simulation Filter (CSF) algorithm. Subsequent processes involve the extraction of distinct lamppost structures from aerial point clouds through a methodology integrating elevation-normalized spatial partitioning and directional coverage analysis, thereby facilitating precise lamppost localization. The culmination of this process involves the refinement of lamppost point clouds through supervoxel clustering complemented by a non-discretization filter grounded in Principal Component Analysis (PCA). The efficacy of this novel approach is substantiated through empirical studies employing a LiDAR dataset encompassing extensive adhesive scenarios, whereupon comparative analysis with extant methodologies reveals its enhanced proficiency in isolating individual lampposts in complex environments.

Interactive machine learning for segmenting pores of sandstone in computed tomography images

In the realm of gas field development and CO2/H2 geological storage, the precise characterization of reservoir parameters stands as a critical role. In recent years, digital rock technology has emerged as a cutting-edge tool for examining micro-pore structures, permeability parameter characteristics, and reservoir flow mechanisms. However, there are still certain defects in image segmentation, where low-density pore bodies in low-resolution images make it difficult to clearly distinguish between pores and solid minerals, affecting the accuracy of pore segmentation. This article aims to improve the accuracy of sandstone pore segmentation. We utilized the interactive machine learning segmentation method to segment pore structures and compare the segmented images obtained with the traditional ImageJ grayscale threshold segmentation methods. Furthermore, we evaluated the effectiveness of different segmentation methods quantitatively using the confusion matrix. The research results indicate that the segmentation quality (F1 score) of the machine learning method is higher than the grayscale methods, and the segmentation effectiveness of machine learning method is more stable. To further validate the accuracy of the machine learning method, we simulated the permeability and the results were compared with the experimental results, and the results show that the deviation in permeability segmented through machine learning methods is the smallest. Therefore, our results demonstrate the effective application of the machine learning method in segmenting sandstone pores in the digital rock images.

Hybrid deep learning and optimal graph search method for optical coherence tomography layer segmentation in diseases affecting the optic nerve

Accurate segmentation of retinal layers in optical coherence tomography (OCT) images is critical for assessing diseases that affect the optic nerve, but existing automated algorithms often fail when pathology causes irregular layer topology, such as extreme thinning of the ganglion cell-inner plexiform layer (GCIPL). Deep LOGISMOS, a hybrid approach that combines the strengths of deep learning and 3D graph search to overcome their limitations, was developed to improve the accuracy, robustness and generalizability of retinal layer segmentation. The method was trained on 124 OCT volumes from both eyes of 31 non-arteritic anterior ischemic optic neuropathy (NAION) patients and tested on three cross-sectional datasets with available reference tracings: Test-NAION (40 volumes from both eyes of 20 NAION subjects), Test-G (29 volumes from 29 glaucoma subjects/eyes), and Test-JHU (35 volumes from 21 multiple sclerosis and 14 control subjects/eyes) and one longitudinal dataset without reference tracings: Test-G-L (155 volumes from 15 glaucoma patients/eyes). In the three test datasets with reference tracings (Test-NAION, Test-G, and Test-JHU), Deep LOGISMOS achieved very high Dice similarity coefficients (%) on GCIPL: 89.97±3.59, 90.63±2.56, and 94.06±1.76, respectively. In the same context, Deep LOGISMOS outperformed the Iowa reference algorithms by improving the Dice score by 17.5, 5.4, and 7.5, and also surpassed the deep learning framework nnU-Net with improvements of 4.4, 3.7, and 1.0. For the 15 severe glaucoma eyes with marked GCIPL thinning (Test-G-L), it demonstrated reliable regional GCIPL thickness measurement over five years. The proposed Deep LOGISMOS approach has potential to enhance precise quantification of retinal structures, aiding diagnosis and treatment management of optic nerve diseases.

Improved Real-Time Models for Object Detection and Instance Segmentation for Agaricus bisporus Segmentation and Localization System Using RGB-D Panoramic Stitching Images

The segmentation and localization of Agaricus bisporus is a precondition for its automatic harvesting. A. bisporus growth clusters can present challenges for precise localization and segmentation because of adhesion and overlapping. A low-cost image stitching system is presented in this research, utilizing a quick stitching method with disparity correction to produce high-precision panoramic dual-modal fusion images. An enhanced technique called Real-Time Models for Object Detection and Instance Segmentation (RTMDet-Ins) is suggested. This approach utilizes SimAM Attention Module’s (SimAM) global attention mechanism and the lightweight feature fusion module Space-to-depth Progressive Asymmetric Feature Pyramid Network (SPD-PAFPN) to improve the detection capabilities for hidden A. bisporus. It efficiently deals with challenges related to intricate segmentation and inaccurate localization in complex obstacles and adhesion scenarios. The technology has been verified by 96 data sets collected on a self-designed fully automatic harvesting robot platform. Statistical analysis shows that the worldwide stitching error is below 2 mm in the area of 1200 mm × 400 mm. The segmentation method demonstrates an overall precision of 98.64%. The planar mean positioning error is merely 0.31%. The method promoted in this research demonstrates improved segmentation and localization accuracy in a challenging harvesting setting, enabling efficient autonomous harvesting of A. bisporus.

An improved attention module based on nnU-Net for segmenting primary central nervous system lymphoma (PCNSL) in MRI images1.

Accurate volumetric segmentation of primary central nervous system lymphoma (PCNSL) is essential for assessing and monitoring the tumor before radiotherapy and the treatment planning. The tedious manual segmentation leads to interindividual and intraindividual differences, while existing automatic segmentation methods cause under-segmentation of PCNSL due to the complex and multifaceted nature of the tumor. To address the challenges of small size, diffused distribution, poor inter-layer continuity on the same axis, and tendency for over-segmentation in brain MRI PCNSL segmentation, we propose an improved attention module based on nnUNet for automated segmentation. We collected 114 T1 MRI images of patients in the Huashan Hospital, Shanghai. Then randomly split the total of 114 cases into 5 distinct training and test sets for a 5-fold cross-validation. To efficiently and accurately delineate the PCNSL, we proposed an improved attention module based on nnU-Net with 3D convolutions, batch normalization, and residual attention (res-attention) to learn the tumor region information. Additionally, multi-scale dilated convolution kernels with different dilation rates were integrated to broaden the receptive field. We further used attentional feature fusion with 3D convolutions (AFF3D) to fuse the feature maps generated by multi-scale dilated convolution kernels to reduce under-segmentation. Compared to existing methods, our attention module improves the ability to distinguish diffuse and edge enhanced types of tumors; and the broadened receptive field captures tumor features of various scales and shapes more effectively, achieving a 0.9349 Dice Similarity Coefficient (DSC). Quantitative results demonstrate the effectiveness of the proposed method in segmenting the PCNSL. To our knowledge, this is the first study to introduce attention modules into deep learning for segmenting PCNSL based on brain magnetic resonance imaging (MRI), promoting the localization of PCNSL before radiotherapy.

Potato powdery scab segmentation using improved GrabCut algorithm

Potato powdery scab is a serious disease that affects potato yield and has widespread global impacts. Due to its concealed symptoms, it is difficult to detect and control the disease once lesions appear. This paper aims to overcome the drawbacks of interactive algorithms and proposes an optimized approach using object detection for the GrabCut algorithm. We design a YOLOv7-guided non-interactive GrabCut algorithm and combine it with image denoising techniques, considering the characteristics of potato powdery scab lesions. We successfully achieve effective segmentation of potato powdery scab lesions. Through experiments, the improved segmentation algorithm has an average accuracy of 88.05%, and the highest accuracy can reach 91.07%. This is an increase of 46.28% and 32.69% respectively compared to the relatively accurate K-means algorithm. Moreover, compared to the original algorithm which could not segment the lesions independently, the improvement is more significant. The experimental results indicate that the algorithm has a high segmentation accuracy, which provides strong support for further disease analysis and control.

A Novel Multi-Scale Feature Map Fusion for Oil Spill Detection of SAR Remote Sensing

The efficient and timely identification of oil spill areas is crucial for ocean environmental protection. Synthetic aperture radar (SAR) is widely used in oil spill detection due to its all-weather monitoring capability. Meanwhile, existing deep learning-based oil spill detection methods mainly rely on the classical U-Net framework and have achieved impressive results. However, SAR images exhibit high noise, blurry boundaries, and irregular shapes of target areas, as well as speckles and shadows, which lead to the loss of performance in existing algorithms. In this paper, we propose a novel network architecture to achieve more precise segmentation of oil spill areas by reintroducing rich semantic contextual information before obtaining the final segmentation mask. Specifically, the proposed architecture can re-fuse feature maps from different levels at the decoder end. We design a multi-convolutional layer (MCL) module to extract basic feature information from SAR images, and a feature extraction module (FEM) module further extracts and fuses feature maps generated by the U-Net decoder at different levels. Through these operations, the network can learn rich global and local contextual information, enable sufficient interaction of feature information at different stages, enhance the model’s contextual awareness, and improve its ability to recognize complex textures and blurry boundaries, thereby enhancing the segmentation accuracy of SAR images. Compared to many U-Net based segmentation networks, our method shows promising results and achieves state-of-the-art performance on multiple evaluation metrics.

Structural Analysis of Glazed Tubular Tiles of Oriental Architectures Based on 3D Point Clouds for Cultural Heritage

Abstract. Laser scanning, along with its resultant 3D point clouds, constitutes a prevalent method for the documentation of cultural heritage. This paper introduces a novel workflow for the structural analysis of glazed tubular tiles that adorn the roofs of historical buildings in the Orient, utilizing 3D point clouds. The workflow integrates a robust segmentation algorithm utilizing the maximum principal curvature and normal vectors. Moreover, clustering algorithms, including DBSCAN, are incorporated to refine the clusters and thus increase segmentation accuracy. Structural analysis is enabled by cylindrical model fitting, which allows for the estimation of parameters and residuals. While the results exhibit commendable performance in individual tile segmentation, it is imperative to address the impact of substantial variations in scanning range and incident angles before engaging in the structural analysis fitting process. The results of experiment demonstrate that under conditions of significantly large scanning angles, the root mean square error (RMSE) for inadequately fitted tiles can extend to 0.066 m, surpassing twice the RMSE observed for well-fitted tiles. The proposed workflow proves to be applicable and exhibits significant potential to advance practices in cultural heritage documentation.

Comparing Deep Learning and MCWST Approaches for Individual Tree Crown Segmentation

Abstract. Accurate segmentation of individual tree crowns (ITC) segmentation is essential for investigating tree-level based growth trends and assessing tree vitality. ITC segmentation using remote sensing data faces challenges due to crown heterogeneity, overlapping crowns and data quality. Currently, both classical and deep learning methods have been employed for crown detection and segmentation. However, the effectiveness of deep learning based approaches is limited by the need for high-quality annotated datasets. Benefiting from the BaKIM project, a high-quality annotated dataset can be provided and tested with a Mask Region-based Convolutional Neural Network (Mask R-CNN). In addition, we have used the deep learning based approach to detect the tree locations thus refining the previous Marker controlled Watershed Transformation (MCWST) segmentation approach. The experimental results show that the Mask R-CNN model exhibits better model performance and less time cost compared to the MCWST algorithm for ITC segmentation. In summary, the proposed framework can achieve robust and fast ITC segmentation, which has the potential to support various forest applications such as tree vitality estimation.